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SUMMARY 

that  a  certain  tour  of  49 
In  eaoh  of  the  48  states  and 
D.  C.,  has  the  shortest  road 


4 


SOLUTION  OP  A  LARGE  SCALE  TRAVELING 
SALESMAN  PROBLEM* 

by 

G.  Dentzig,  R.  Fulkerson, 
and 

S.  Johnson 

1*  Introduction.  The  traveling  salesman  problem  might  be  described 
as  follows:  Find  the  shortest  route  (tour)  for  a  salesman  starting 
from  a  given  city,  visiting  eaeh  of  a  specified  group  of  cities,  and 
then  returning  to  the  original  point  of  departure.  More  generally, 
given  an  n  by  n  symmetric  matrix  D  -  (d^),  where  d^  represents  the 
"distance H  from  1  to  J,  arrange  the  points  in  a  cyclic  order  in  such 
a  way  that  the  sum  of  the  d^  between  consecutive  points  Is  minimal. 
Since  there  are  only  a  finite  number  of  possibilities  (at  most 
^  to  consider,  the  problem  Is  to  devise  a  method  of  picking 
out  the  optimal  arrangement  which  la  reasonably  efficient  for 


Historical  note:  The  origin  of  this  problem  Is  somewhat 
obscure,  tt  appears  to  have  been  discussed  infonnally  among 
mathematicians  at  mathematics  meetings  for  many  years.  Sur¬ 
prisingly  little  In  the  way  of  results  has  appeared  In  the 
mathematical  literature  0LO]  •  It  may  be  that  the  minimal 
distance  tour  problem  was  stimulated  by  the  so-called 
Hamiltonian  Game  Qj  which  is  concerned  with  finding  the 
number  of  different  tours  possible  over  a  specified  network. 

The  latter  problem  la  cited  by  some  as  the  origin  of  group 
theory  and  has  some  connections  with  the  famous  Four  Color 
Conjecture  .  Merrill  Flood  (Columbia  University)  should 
be  credited  with  stimulating  Interest  In  the  traveling  salesman 
problem  in  many  quarters.  As  early  as  1937,  he  tried  to  obtain 
near  optimal  solutions  in  reference  to  routing  of  school  buses. 
Both  Flood  and  A.  W.  Tucker  (Princeton  University)  recall  that 
they  heard  about  the  problem  first  in  a  seminar  talk  by  Hassler 
Whitney  at  Princeton  in  193^  (although  Whitney,  recently  queried, 
does  not  seem  to  recall  the  problem).  Hie  relations  between 
the  traveling  salesman  problem  and  the  transportation  problem 
of  linear  programming  appear  to  have  been  first  explored  by 
M.  Flood,  J.  Robinson,  T.  C.  Koopmans,  M.  Beckmann,  and  later 
by  I.  Heller  and  H.  Kuhn  5,  q]  . 
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fairly  large  values  of  n.  Although  algorithms  have  been  devised 
for  problems  of  similar  nature,  e.g.,  the  optimal  asaignment  problem 
Q ,  7,  6],  little  is  known  about  the  traveling  salesman  problem. 

We  do  not  claim  that  this  note  alters  the  situation  very  much; 
what  we  shall  do  is  outline  a  way  of  approaching  the  problem  that 
soma  times,  at  least,  enables  one  to  find  an  optimal  path  and  prove 
it  so.  In  particular,  it  will  be  shown  that  a  certain  arrangement 
of  49  cities,  one  in  each  of  the  48  states  and  Washington,  D.  C., 
la  best,  the  d^j  used  representing  road  distances  as  taken  from 
an  atlas. 

In  order  to  try  the  method  on  a  large  problem,  the  following 
set  of  49  cities,  one  in  each  state  and  the  District  of  Columbia, 

was  selected: 
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1.  Manchester ,  New  Hampshire 

2.  Montpelier,  Vermont 

3.  Detroit,  Michigan 

4.  Cleveland,  Ohio 

5*  Charleston,  West  Virginia 
6.  Louisville,  Kentucky 
7*  Indianapolis,  Indiana 

8.  Chicago,  Illinois 

9.  Milwaukee,  Wisconsin 

10.  Minneapolis,  Minnesota 

11.  Pierre,  South  Dakota 

12.  Bismarck,  North  Dakota 

13 .  Helena,  Montana 

14.  Seattle,  Washington 
13-  Portland  Oregon 

16 .  Boise,  Idaho 

17.  Salt  Lake  City,  Utah 

18.  Carson  City,  Nevada 

19.  Los  Angeles,  Calif omla 

20.  Phoenix,  Arisons 

21.  Santa  Fe,  New  Mexico 


22.  Denver,  Colorado 

23 .  Cheyenne ,  Wyoming 

24.  Omaha,  Nebraska 
25*  Des  Moines,  Iowa 

26.  Kansas  City,  Missouri 
27*  Topeka,  Kansas 

28.  Oklahoma  City,  Oklahoma 

29.  Dallas,  Texas 

30.  Little  Rock,  Arkansas 

31.  Memphis,  Tennessee 

32.  Jackson,  Mississippi 
33*  New  Orleans,  Louisiana 
34*  Birmingham,  Alabama 
35*  Atlanta,  Georgia 

36.  Jacksonville,  Florida 
37*  Columbia,  South  Carolina 
38.  Raleigh#  North  Carolina 
39 •  Richmond,  Virginia 
40.  Washington,  D.  C. 

41 •  Boston,  Massachusetts 
42.  Portland,  Maine 


A.  Baltimore,  Maryland 

B.  Wilmington,  Delaware 

C.  Philadelphia,  Pennsylvania 

D.  Newark,  New  Jersey 

E.  New  York,  New  York 

F.  Hartford,  Connecticut 

0.  Provldenoe,  Rhode  Island 


The  reason  for  picking  this  particular  set  was  that  most  of  the 
road  distances  between  them  were  easy  to  get  from  a  Rand  McNally 
atlas.  The  triangular  table  of  distances  between  these  cities 
which  follows  is  part  of  the  original  one  prepared  by  Bernice  Brown 

diJ  *  11  * 

of  The  RAND  Corporation.  It  gives  d.  A  -  — ■ -  ,  i»  J  *  1#  2,  ••• 

1J  17 

where  la  the  road  distance  in  miles  between  1  and  J.  The  d^ 
have  been  rounded  to  the  nearest  integer.  Certainly  such  a  linear 
transformation  does  not  alter  the  ordering  of  the  tour  lengths, 
although,  of  course,  rounding  could  cause  a  tour  that  was  not 
optimal  In  terms  of  the  original  mileage  to  become  optimal  in 
terms  of  the  adjusted  units  used  in  this  paper. 

We  will  show  that  the  tour  (see  Figure  16)  through  the  cities 
1,  2,  •••,  42  in  this  order  is  minimal  for  this  subset  of  42  cities. 
Moreover,  since  in  driving  from  city  40  (Washington,  D.  C. )  to 
olty  41  (Boston,  Massachusetts)  by  the  shortest  road  distance  one 
goes  through  A,  B,  •••,  0  successively,  it  follows  that  the  tour 
through  49  cities  1,  2,  •••,  40,  A,  B,  •••,  0,  41,  42  in  that  order 
is  also  optimal. 


#  i 

This  particular  transformation  was  chosen  to  make  the  d^ 
of  the  original  table  less  than  256  which  would  permit 
compaot  storage  of  the  distance  table  in  binary  representa¬ 
tion;  however,  no  use  was  made  of  this. 
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2.  preliminary;  Motions.  ttienever  the  road  from  1  to  J  (In 

that  order)  la  traveled,  the  value  -  1  la  entered  Into  the 
i,  i  eleaant  of  a  matrix;  otherwlae  x[3  -  0  la  entered.  A  (directed) 
tour  through  n  oltlea  can  now  be  thought  of  ea  a  pemxtatlon  matrix 
of  order  n  which  repreaenta  an  n-cyele.  For  example,  for  n  -  5. . 


the  first  matrix  dlaplayed  below 


0  10  0  0 
0  0  0  1  0 
0  0  0  0  1 
0  0  10  0 


Bip  - 


0 

1 

0 

0 


1 

0 

0 

0 


0  0 
0  0 
0  0 
1  0 


0“ 

0 

1 

0 


0  0  0  1  o J 


la  a  tour  alnea  It  repreaenta  vlaltlng  the  oltlea  In  the  5-cycle 
(12345) ,  while  the  other  matrix  la  not  a  tour  since  It  repreaenta 

A  1  _  ^  4  e  I  V 


/ 


l 


▼lotting  the  oltlea  ay 

»J  '  4  .'A  *L  >4  ,  r'  A  .t *  '•*  JT 


V: 


*w 


v .  iae.'v  .  _■ .  >•  ~  mrirttl  %•»!»''  w-— . 

uToissr  that  ell  ra — aioaetos  wn» 


A?'. 


the  relatlona 


z* 

1 


1J 
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o  , 


xu  >  0  • 


The  matrix  may  be  made  Into  a  triangular  array  by  reflecting  the 
numbers  above  the  diagonal  in  the  diagonal.  The  aum  of  correapong 

x’  ♦  xi.  jibtn  the  aatrteofj^sJ* ff 

A  J  •'  ,  -  ^  ^  *'  L  >5^4  * 

W  <  H  '  -  4  r  J  -•  7V  ^  **4 

5-  “  »*  v<  ■ n  '  **" 


elements  Is  denoted  by  x1j 


*  •  1-".  V 


V 


1  • 

0  0  • 

0  1  1  • 

10.10 


2  • 

0  0  • 

0  0  1* 

0  0  11 


Consequently,  the  sum  along  the  kth  row  plus  the  sum  along  the  k 
column  must  now  be  2,  Ttois  «»y  written 


2  , 


If  n  *  XiJ  - 


>  0  . 


(2.0)  Z  X1J  +  *ij 

j<l-k  l>J-lc 

Thla  device  yields  a  representation  fer  undirected  teere  end  is  the 

one  used  throughout  this  paper.  It  will  te  noted  that  the  second 
array  above  does  not  represent  a  tour  but  also  satisfies  the 

relations  (2.0). 


—  * - -  V  -  - — 

For  undirected  tours,  the  syebol  will  he  treated  identically 


with  so  that  we  may  rewrite  (2.0)  as 


n 


(2.1)  Z  X1J 

J-l 


2,  xiJ^° 


(i 


,  2,  •••,  n,  1  /  J#  Jtjj  e  xji)  • 


Ji 


The  problem  Is  to  find  the  minimum  of  the  linear  form 

<b 

(2.2)  D(x)  -  Ilg  xij 

where  the  ■  0  or  1  and  the  Xjj  -  1  form  a  tour,  and  where  the 

aumnatlon  in  (2.2)  extenda  over  all  indices  (l,j)  such  that  o  >  J. 
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To  make  a  linear  programming  problem  out  of  this  ^see  L2JJ 
one  needs,  as  we  have  observed,  a  way  to  describe  tours  by  more 
linear  restraints  than  that  given  by  (2.1).  Th?s  is  extremely 
difficult  to  do  as  illustrated  by  work  of  I.  Heller  [4]  and 
H.  Kuhn  [S]  .  They  point  out  that  such  relations  always  exist. 
However,  there  seems  to  be  no  simple  way  to  characterize  them 
and  for  moderate  size  n  the  number  of  such  restraints  appears  to 
be  astronomical.  In  spite  of  these  difficulties,  this  paper  will 
describe  the  techniques  we  have  developed  which  have  been  success- 
ful  in  solving  all  the  problems  we  have  tried  by  this  approach. 

A  surprising  empirical  observation  Is  the  use  of  only  a  trivial 
number  of  the  many  possible  restraints  to  solve  any  particular 
problem.  To  demonstrate  the  procedure,  we  shall  attempt  to  use 
direct  elementary  proofs  even  though  they  were  originally  motivated 
In  many  places  by  linear  programming  procedures. 

There  are  possibly  four  devices  we  have  used  which  have  greatly 
reduced  the  effort  in  obtaining  solutions  of  the  problems  we  have 
attempted. 

First  of  dll,  we  use  undirected  tours.  This  seems  to  simplify 
the  characterization  of  the  tours  when  n  is  small  and  certainly 
cuts  down  the  amount  of  computation,  even  for  large  n.  Secondly, 
and  this  is  decisive,  we  do  not  try  to  characterize  the  tours  by 
the  complete  set  of  linear  restraints,  but  rather  impose,  in  addi¬ 
tion  to  (2.1),  Just  enough  linear  conditions  on  the  xij  to  assure 
that  the  minimum  of  the  linear  form  (2.2)  is  assumed  by  some  tour. 
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For  the  49-city  problem  and  alao  for  all  the  smaller  problems  we 
have  considered,  such  a  procedure  has  been  relatively  easy  to  carry 
through  by  hand  computation.  This  may  be  due  in  part  to  the  fact 
that  we  use  a  simple  symbolism  which  permits  direct  representation 
of  the  algebraic  relationships  and  manipulations  on  a  map  of  the 
cities.  This  third  device  speeds  up  the  entire  iterative  process, 
makes  it  easy  to  follow,  and  sometimes  suggests  new  linear  restraints 
that  are  not  likely  to  be  obtained  by  less  visual  methods.  Finally, 
once  a  tour  has  been  obtained  which  is  nearly  optimal,  a  combinatorial 
approach,  using  the  map  and  listing  possible  tours  which  have  not 
yet  bean  eliminated  by  the  conditions  imposed  on  the  problem,  may 
be  advantageous.  This  list  can  be  very  much  shorter  than  one  would 
expect,  due  to  the  complex  interlocking  of  the  rer'raints.  However, 
except  for  short  discussion  in  section  4,  this  method  will  not  be 
described  In  detail  although  it  has  worked  out  well  for  all  examples 
we  have  studied. 

An  Important  class  of  conditions  that  tours  satisfy,  which 
excludes  many  non-tour  cases  satisfying  (2.1),  are  the  "loop 
conditions."  These  are  linear  Inequality  restraints  that  exclude 
subcycles  or  loops.  Consider  a  non-tour  solution  to  (2.1)  which 
has  a  subtour  of  n1  <  n  cities;  we  note  that  the  sura  of  the 
x1  j  for  those  links  (i,  J)  in  the  subtour  is  n1.  Hence  we  can 
eliminate  this  type  of  solution  by  imposing  the  condition  that 
the  sum  of  x.  4  over  all  link3  (1,  J)  connecting  cities  in  the 
subset  3  of  n^  cities  be  less  than  n^  ,  i.e.. 
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(2.3)  H  xij  <  ni  “  1 

s 

where  the  summation  extends  over  all  (1,  J)  with  1  and  J  in  the 
n1  cities  S.  From  (2.1)  we  note  that  two  other  equivalent  condi¬ 
tions  are 

(2.4)  H  xi j  <  n  -  nx  -  i  , 

J 

where  ^  means  the  summation  extends  over  all  (i,  J)  such  that 
neither  i  nor  J  is  in  S,  and 

(2.5)  II  >  2  * 

SS 

where  S$  means  the  summation  extends  over  all  (l,  j)  such  that  i 
is  in  S  and  J  not  in  S. 

There  are,  however,  other  more  complicated  types  of  restraints 
which  sometimes  must  be  added  to  (2.1)  in  addition  to  an  assortment 
of  loop  conditions  in  order  to  exclude  solutions  involving  frac¬ 
tional  weights  x^.  In  the  49-city  case  we  needed  two  such  condi¬ 
tions.  However,  later  when  we  tried  the  combinatorial  approacn 
after  imposing  only  a  few  of  the  loop  conditions,  we  found  we 
could  handle  the  49-city  problem  without  the  use  of  trie  special 
restraints  and  this  would  have  led  to  a  shorter  proof  of  optimality. 
It  is  conjectured  that  one  can  use  the  combinatorial  arguments 
together  with  loop  conditions  to  solve  any  traveling  salesman 
problem  of  moderate  size  in  a  reasonable  time. 


-11- 


3.  The  Method.  The  technique  will  be  Illustrated  by  a  aeries  of 
simple  examples. 


Example  1 


First  consider  a  five-city  map  forming  a  regular  pentagon 
of  unit  length  per  side  and  with  length  ^  ^  1 )  1*7  on  a 


diagonal . 


Suppose  that  toe  problem  la  to  minimize  (2*2)  subject  only 

> 

to  (2.1).  Start  Witt  «  tour  which  1b  conjectured  to  bo 
optimal,  obviously  (1  2  3  “  5).  In  this  case  the  values  of  xir 

denoted  by  x^,  are  x12  -  x25  -  xj4  -  x^5  -  *51  “  1  and  ali  oth,r 

x  *  0.  The  variables  x.  .  corresponding  to  links  on  the  tour  are 
i  J  *■  J 

called  "basic  variables."  The  length  of  the  tour  given  by  the 
linear  form  (2.2)  for  x  -  x  Is  D(x)  -  5-  There  are  five  equations 
In  (2.1).  Multiply  each  by  a  parameter  to  be  determined,  and 
then  subtract  the  sum  from  (2.2).  Thus,  we  are  led  to 
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D(X>  “  i£j  dljXlJ  ~  ^  C> 


xu  ■  xji*  1  *  J3 


n 


-^j(iri +  -du)xij +  2^Ti  • 


Denote  the  coefficients  of  x^  by  5^  so  that 


n 


(3.1)  D(x)  -  -  ^6ijxij  +  2  vi 


(6lj  ■  T1  +  Tj  *  dlj)‘ 


Now  determine  the  five  values  so  that  5^  corresponding  to 
basic  variables  vanish: 


(3.2)  6 


1J 


for  x 


1J 


1  , 


i.e.,  if  the  link  (l,j)  Is  on  the  tour  In  question.  Note  thd t 
to  solve  for  the  w ^  we  have  five  linear  equations  in  five  unknowns. 

If  new  we  set  x^j  •  In  (>.l),  then  •  0  1^ 

ig  (l.J) 

(3-3)  D(x)  -  2  T  -  5  • 

Subtracting  (3*3)  from  (3*1)  we  have  finally 
(3.<0  E(x)  -  D(x)  =  -  £  6ljXlJ  . 

For  the  regular  pentagon  -  j  for  1  «  1,  2,  3.  **>  5  solves  (3.2), 
and*  so  61,  -  |  (1  -V5)  <  0  on  a  diagonal,  l.e.,  B1J  <  0  for  every 
(l,j).  Thus,  the  right  side  of  (3.1*)  Is  always  nonnegative 


\ 

v 


or  D(x)  >  D(x)  for  all  x  satisfying  (2.1),  and  ir  particular 
all  othsr  tours  art  longer  than  the  tow*  ^presented  by  x. 
Example  2 

Next,  take  another  five-city  problem  whose  map  is  n  ->t  a 
regular  pentagon:  _ 


We  start  with  the  tour  (12345)  of  length  D(x)  *  32  where 


the  basic  variables  take  on  the  values  x, 


A 

-  X, 


A 

X, 


12  "  "23  34  "  *45 

i  cuivj  wxx  wuici  ^ij  ”  0.  Repeat  the  steps  in  the  pre¬ 
vious  problem  leading  to  (3*4)  where,  as  before,  calculate  the 


A 

X, 


1  and  all  other  x. 


7 by  setting  6^  «  0  for  6^  corresponding  to  bnsic  variables 
xiJ*  The  equations  that  the  tt^  must  satisfy  are 


7T^  4"  7T  ^  *  5#  ^2  4"  7T  ^  =  8,  7T  ^  +  ^5  *  6  , 

"5  +  Ti  ■  8 

By  alternately  subtracting  and  adding  these  equations  one  obtains 


*  ^i2~^23+^34”^45+^51  “5  —  5+8  —  6  +  8  ■  10, 

\ 


or 
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ir ^  —  5 $  m  5#  *  3*  “3  • 

The  factors  which  multiply  equations  (2.1)  to  form  (3*4) 
are  called  "potentials."*  There  Is  one  such  potential  associa— 
ted  with  each  city  1,  and  these  are  readily  computed  by  working 
directly  on  the  map  of  the  cities  (see  Pig.  3)*  , 

To  form  other  6jj,  add  the  and  ttj  of  city  1  and  city  J 
and  subtract  off  the  distance  d^j  between  them.  In  this  case 
we  not#  that  exoepi  for  •*>♦5-6-44,  all  the  other 

°U  *"^0, 

We  see  from  (3-4)  that  If  were  to  take  on  a  positive 
value,  x^  -  the  other  nonbaslc  variables  remaining  at  zero, 
this  may  ledd  to  a  better  solution.  We  let  O  be  the  largest 
value  consistent  with  (2.1).  Thus,  the  weights  x ^  must  add  up 
to  2  on  links  from  each  city  and  no  weight  is  negative.  How¬ 
ever,  in  setting  x?]  -  4  we  adjust  only  the  basic  set  of  vari¬ 
ables,  leaving  all  other  nonbaslc  variables  at  zero  value.  This 
1b  worked  out  on  the  map  below  (Fig.  4). 


Th«  term  potential  Is  used  by  T.  C.  Koopmans^  in  an  analogous 
connection  for  the  transportation  problem  [5j  . 
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Here  the  maximum  value  of  0  is  1,  and  this  leads  to  a  >-cycle 
(l  2  3)  and  a  2-cycle  (4  5)  (Fig.  5)* 


This  is  not  a  tour,  so  we  add  a  loop  condition  w.iich  excludes 
tnis  so lut Ion  but  which  is  satisfied  by  all  tours.  In  this 
case  <  1  or 

(3. 5)  +  yg  -  1  ’  0  y6  -  °’ 

Is  sucn  a  condition.  Accordingly,  we  3tart  over  again  using  the 
five  equations  (2.1)  and  the  sixth  equation  (3-5).  This  time 
we  will  need  six  basic  variables  and  it  will  be  convenient 
to  have  x  ?  (the  one  we  set  equal  to  $  previously)  Included  with 
those  associated  with  the  tour.  Thus,  the  starting  solution  is 
as  follows:  The  basic  variables  have  values  x12  -  x2^  -  x^4  -  *45 
■t,  All  other  S.,  -  0.  This  solution  is  shown 

in  Fig.  6.  The  presence  of  an  upper  bound  on  x^^  or  relation 
(3.5)  is  depicted  in  Fig.  6  by  a  block  symbol  on  (4,5). 


Now  we  nmltiply  equation  (3*5)  by  Tg,  add  it  t©  X  MX 


'  ■  '  y-j  /Y.r*t 

,  -Vu‘  V*  •  e-v  vW 


—  2 


subtract  the  sun  from 
before.  The  result  is 


/ 


diJxiJ  and  collect  berms  in  x^  aa 


»  we*  4 1  •* 


(3-6) 


dljxlj 


6ijxlJ  +  2 


*1  +  r6(l-y6) 


where  8j*  “  *1  +  TJ  “  dlj  MC*Pt  6^  *  ir^  +  ir^  —  (d^  —  Xg). 

Now  determine  the  six  values  of  ir^  by  setting  6^  •  0 
corresponding  to  basic  variables  x^jj 


(3*7)  "  ®23  "  ®^4  "  ^45  "  ^51  ™  ^13  * 


from  which  it  follows  that 


(3.8)  D(x)  -  D(x)  -  -  21  6ljxlJ  ~w6y6 

i  ‘  • 

•  •  ~  •  y  k.  _ 

To  evaluate  v^  we  note  that  there  are  six  equations  in  six 
unknowns.  These  are  shown  on  the  map  below  (Pig.  7).  The  three 
conditions  about  the  triangular  loop  (1,2,3)  permits  us  to  solve 
for  ,  Vg,  Try  Branching  out  from  the  trianglte  we  get  next 
and  and  finally  Thus,  we  determine  first  that  2v^ 

*  d|2  *  d23  t  ^  *  5  “  5  ^  6  so  that  ir^  ■  3,  Tg  *  2,  tt^  •  3* 

Working  down,  /r^  -  5*  ^  ■  5.  Thus,  ir^  +  ir^  ■  -  irg  +  6,  so  •  -  4. 
These  values  are  shown  adjacent  to  each  city  in  Fig.  7. 


■  r  . 
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relation  (3.2)  Implies  that  the  ir1  satisfy  the  relations  shown 
In  Fig.  8.  In  this  case  (and  this  is  generally  true  for  loops 
with  an  even  number  of  links)  the  sum  of  equations  on  links 
(1,2),  (3,^)#  (5,6)  Is  Identical  with  the  sum  for  (2,3)#  (4,3)# 
(6,7)  except  for  different  constant  terms,  so  that  the  system 

of  equations  In  iri  Is  Inconsistent. 

This  difficulty  can  be  avoided  if  the  following  general  rule 
is  followed:  The  set  of  basic  variables  must  be  so  selected 
that  when  the  remaining  are  fixed,  the  values  of  the  basic 
variables  are  uniquely  determined.  This  means  the  matrix  of 
coefficients  of  the  basic  variables  is  nonsingular  (i.e.,  their 
determinant  is  nonvanishing).  Since  the  t satisfy  a  system  of 
equations  whose  coefficient  matrix  is  the  transpose  of  this 
matrix,  the  will  be  uniquely  determined  also.  In  the  6-clty 
case,  one  may  augment  system  (2.1)  with  the  additional  upper- 
bound  condition 

(3-9)  +  y7  *  i  ^  °) 

and  select  xl3  as  a  basic  variable  in  addition  to  the  basic 
variables  x^  1  corresponding  to  (i,j)  on  the  tour.  Then,  letting 
tt7  be  the  weight  associated  with  restriction  ( 3 •  9 )  #  "he  tt^  sat¬ 
isfy  relations  in  Fig.  9* 


0 


The  value  of  ^  *  5/2  can  be  determined  from  the  odd  loop 
(1  2  3)  by  alternately  adding  and  subtracting  the  equations  around 
the  loop.  The  others  can  then  be  evaluated  Immediately.  In 
this  case,  we  have  analogous  to  (3-8) 

(3.10)  D(x)  -  D(x)  -  -  21  6ijxij  ~  r7y7 


where  6^  ■  0  if  x^j  is  a  ba3ic  variable  and  6^  ■  wi  +  WJ  ~  ^lj 
otherwise.  Since  6^  «  3>  Increasing  the  value  of  to  £  (while 
all  other  nonbaslc  variables  remain  zero),  with  corresponding 
adjustments  in  the  basic  variables,  will  yield  D(x)  -  D(x)  •  —  3£  <  0, 
In  Fig.  10  It  lc  seen  that  the  largest  value  of  &  •  1  and  the 
resulting  solution  Is  Fig.  11,  which  Is  not  a  new  tour,  but  two 
loops.  However,  we  can  exclude  this  solution  by  Imposing  the 


additional  restriction  satisfied  by  all  tour  solutions 
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(3.11)  x12  +  x23  +  x31  <  2,  or  x12  +  x23  +  x?1  +  y8  -  2,  (yg  > 

since  in  Fig.  11  the  inadmissible  solution  has  xi2 +  x23  *  x3i  " 

We  now  start  all  over  again  augmenting  relations  (2.1)  by  (3.9) 
and  (3.11).  Let  the  basic  variables  be  the  same  as  before  but 
include  (i.e.,  the  one  we  set  equal  to  G  in  Fig.  10).  Let 
T  for  1$  2,  •••,  8  be  the  weights  assigned  to  these  relations 
respectively  in  forming  D(x)  -  D(x);  then  the  ir1  satisfying  the 
relations  shown  in  Fig.  12 


where  the  loop  condition  (3.11)  is  symbolized  by  the  dotted  loop 
in  the  figure. 
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The  value  of  »  2  may  be  evaluated  from  the  odd  loop 
(6  4  3  2  1)  by  alternately  adding  and  subtracting  the 
equations  in  tt^  shown  on  this  loop.  The  other  can  then  be 
immediately  determined.  This  time 

4 

(3.11)  D(x)  -  D(x)  -  -  H  -  Tr?y7  -  7r8y8 

where  »  0  for  x^  a  basic  variable  and  “  dij 

otherwise.  Since  only  ^4  3  ^  other  <  0,  we 

set  x  k  -  0;  then  the  adjustments  in  the  values  of  the  basic 
variables  necessary  to  satisfy  (2.1),  (3*9)*  (5.11)  are  shown 
in  Fig.  13  and  the  new  solution  for  0  =*  1  is  a  new  tour  $  with 
length  D(x)  =*  D(x)  -  1  -  22,  Fig.  14.  We  may  now  drop  x^4  -  0 
from  the  basic  set  of  variables  (or  alternatively  x12)  and  replace 
it  by  x24  83  a  new  basic  variable,  lliis  yields  the  relations  for 
of  Fig.  15.  The  expression  for  D(x)  —  D(x)  is  similar  to 

(3.11) .  It  can  now  be  tested  that  all  <  0  corresponding  to 

non-oasic  x4  y  and  the  coefficients  of  y^  and  yg  are  tt^  <  0, 

ttc  <  0,  so  that  the  new  tour  is  established  as  optimal, 
o  — 


4.  An  Estimation  Procedure.  In  any  linear  programming  problem 
with  bounded  variables,  an  estimate  is  available  of  how  much  a 
basic  solution  differs  from  an  optimal  solution.  Let  D(x) 
represent  a  linear  form  to  be  minimized  and  D(x)  be  tne  val 
for  some  basic  solution  x  where  variables  (x^,  X2#  ' *  *  *  x^,), 
represented  by  the  symbol  x, satisfy  a  system  of  equations  as 
well  as  bounds  0  <  Xj  <  Ty  If  the  equations  are  multiplied  by 
weights  7ri  and  subtracted  from  D(x),  then  (as  we  have  noted  earlier) 

(4.1)  D(x)  -  D( x )  =  -  £  SjXj  (Xj  >  0) 

where  7r^  are  chosen  such  that  *  0  if  the  corresponding  i3  a 
basic  variable.  We  may  now  split  the  right  side  of  (4.1)  Into 
positive  and  negative  parts  and  obtain  a  lower  bound  for  h^ 
difference  by  dropping  the  positive  part,  i.e. 

j 
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til. 2)  D(x)  -  D(x)  ■  - 


6/° 


°JXJ 


"6|o6JxJ 

J— 


(Xj  > 


0) 


(4.3) 


D(x)  -  D(x)  >  -  X  6ixi  >  ~  E 

-  6j?0  J  J 


(E  >  0) 


where  — E  is  some  estimate  for  the  negative  part.  By  setting 

x  «  r , ,  we  obtain  in  particular 
J  J 


(4.4)  D(x)  -  D(x)  >  - 


Vj 


j 


For  the  traveling  salesman  problem  the  variables  x^j  must 
ce  eiti  er  0  or  1  if  x  represents  a  tour.  Prom  (4.2),  no  link 
(i,j)  can  occur  in  an  optimal  tour  if 


(4.5)  °ij  <  ~  E  ' 

hence  all  corresponding  variables  x^j  can  be  droppe  i  front  further 
corjsideration . 

During  the  early  stages  of  the  computation,  E  may  ue  quite 
large  and  very  few  links  can  be  dropped  by  this  rulej  * owever, 
lr.  the  latter  stages  often  so  many  links  are  eliminated  that  one 
can  list  all  possible  tours  that  use  the  remaining  admissible 
links.  y  extending  this  type  of  combinatorial  argument  to  the 
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range  of  values  of  the  "slack"  variables  yk,  It  Is  often  possible 
at  an  earlier  stage  of  the  Iterative  algorithm  to  rule  out  so 
many  of  the  tours  that  direct  examination  of  the  remaining  tours 
for  minimum  length  is  a  feasible  approach. 

5,  The  49-City  Problem.*  The  optimal  tour  x  is  shown  In  Pig.  1 6. 
The  proof  that  it  is  optimal  is  given  in  Pig.  17.  To  make  the 
correspondence  between  the  latter  and  its  programming  problem 
clear,  we  will  write  down  in  addition  to  42  relations  in  non¬ 
negative  variables  (2.1),  a  set  of  25  relations  which  suffice 

to  prove  that  D(x)  is  a  minimum  for  x.  We  distinguish  the  fol— 

* 

lowing  subsets  of  the  42  cities : 

Sj  -  {1,  2,  41,  42] 

S2  -  {?.  * . 9} 

S  -  <  1,  2,  ,  9,  29,  30,  . . • ,  42] 

• *  11 ,  12 ,  ...  1  23  t 

55  -  {l3,  14,  ....  23} 

56  -  (13,  14,  15,  16,  17] 

S?  -  {24,  23,  26,  27} 

Except  for  two  Inequalities  which  we  will  discuss  in  a  moment, 
the  programming  problem  may  now  be  written  as : 


•As  indicated  earlier,  it  was  possible  to  treat  this  as 
a  42-city  problem. 
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^  x1J  -  a  (l-l,...,42),  x4l>1  <  1.  *4>5  <  1.  <  1, 

*9,8  ^  *»  x12,ll  ^  X'  xl4,13  ^  lf  x15,14  ^  *'  x20,19  ^  *' 
*23,22  ^  X»  x25,24  ^  X»  x27,26  ^  X*  *29,28  ^  1*  *31,30  1  2» 


53,32  J*  *35,34  *  x37,36  *  J«  s  I§  xlj  >  2»\  L  xij  >  2. 

sl'sl  s2»s2 


L-  xu  > 2- 


s3,s3 


Z*  xij  *  2« 


S4'S4 


g  ^6  *1J  — 
S5'S5 


2#  Z  xiJ  ^  Z  xn  <  5. 


U 


The  remaining  two  relations  66  and  67  are  perhaps  most  easily 
desorlbed  verbally.  The  firet  says  that  Xj^  15  minus  the  sum 
of  all  othor  on  link®  out  of  15,  16,  19,  oxeopt  for  *l8  15# 

xl8,l6'  x17,l6#  xi9,i8*  40(1  x20,19#  which  do  not  appear  In  the  sum. 
Is  not  positive;  the  second  that  <  42,  where  a^  22  ■  2, 

*26,25  "  other  a^j*l  except  a^j»0  if  x^j  Is  a  non— basic 

variable  and  either  (a)  1  Is  In  S^,  J  not  In  or  (b)  1  or  J  Js 
10,  21,  25,  26,  27,  or  28. •• 


•  T 


gt-gXlJ  m**ns  4he  8Uln  variables  where  only  one 


of  the 


subscripts  1  or  J  Is  In  S.  means  the  sum  of  all  variables 

such  that  1  and  J  are  In  S — see  relations  (2.3),  (2.4),  (2.5). 

**We  are  Indebted  to  I.  Glicksberg  of  RAND  for  pointing  out 
relations  of  this  kind  to  us. 
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These  two  inequalities  are  satisfied  by  all  tours.  For  example, 
if  a  tour  were  to  violate  the  first  one,  it  must  have  successively 

*15,14-1.  *13, 15"1'  *18, 16"1'  but  also  x19,18“1'  a  contradiction. 
The  argument  that  each  tour  satisfies  the  second  inequality  is 

similar  but  somewhat  more  involved,  and  we  omit  it.  These  re¬ 
lations  were  imposed  to  cut  out  fractional  solutions  which 
satisfied  all  the  conditions  (2.1)  and  (2.3). 

We  assert  that  if  the  weights  are  assigned  to  these 
restraints  in  the  order  presented  above,  then  the  values  as  given 
in  Fig.  17  satisfy  6^-0  for  all  variables  x^  in  the  basis. 

With  these  values  of  v ^  in  the  expression  for  D(x)  -  D(x),  all 
6lj  <  0  corresponding  to  variables  x^j  and  •  •  •  ^67 

corresponding  to  variables  y^,  •  •  *^67  are  appropriately  positive 
or  negative  (positive  if  its  y  occurs  with  a  minus  sign  in  the 
relation,  negative  otherwise)  with  the  exception  of  t ^ 
where  xg^  ^  +  y^2  •  1.  This  proves,  since  E  •  i  and  all  the 
d^j  are  integers,  that  x  is  minimal.  The  length  D(x)  is  699 
units,  or  12,345  miles  except  for  rounding  errors. 

It  can  be  shown  by  introducing  all  links  for  which  5 

that  x  is  the  unique  minimum.  There  are  only  7  such  links  in 
addition  to  those  shown  in  Fig.  17,  and  consequently  all  possible 
tying  tours  were  enumerated  without  too  much  trouble.  None  of 
them  proved  to  be  as  good  as  x  • 


6.  Concluding  remark.  It  is  clear  that  we  have  left  unanswered 
practically  any  question  one  might  pose  of  a  theoretical  nature 
concerning  the  traveling  salesman  problem;  i  owever,  we  hope  that 
the  feasibility  of  attacking  problems  involving  a  moderate  number 
of  points  has  been  successfully  demonstrated,  and  that  perhaps 
some  of  the  ideas  can  be  used  in  problems  of  similar  nature. 
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